Parental imprisonment tends to result in family predicament, causing changes in family and social environment that would bring serious psychological pressure to children. Based on the health ecological model, using the data from “Research on the Health Status of Children in Difficult Families” to analyze the impact of parental imprisonment on children's mental health from the perspective of family and social environment. The study shows that mental health status of children of prisoners is significantly worse; and family environment, social interaction and social bullying are important affecting factors. Compared with ordinary children, mental health of children of prisoners is more susceptible to negative events such as abuse by their caregivers and bad social interaction. Therefore, in addition to family environment, it is necessary to create a good social environment to reduce prejudice and discrimination against these children, to improve their growth environment and promote their physical and mental health development.